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This invention relates to a system and method for verifying the authenticity of an 
object and securing a set of data. 

BACKGROUND OF THE INVENTION 

Due to the rapid advances in computers, CCD technology, image-processing 
hardware and software, printer, and copiers, there is an increase potential of fi-aud by 
reproducing the patterns and pictiires used to verify the authenticity of the objects. The 
appUcation of optical processing and pattem recognition for security verification of credit 
cards, passports and other forms of biometric image identification have been proposed (B. 
Javidi and J.L. Homer, "Optical Pattem Recognition for Validation and Security 
Verification," Opt. Eng., 55(6), 1752-1756 (1994); H.-Y. Li, Y. Qiao, and D. Psaltis, 
"Optical Network for Real-time Face Recognition", Appl. Opt. 32, 5026-5035 (1993); T. 
Grycewicz, and B. Javidi, "Experimental Comparison of Binary Joint Transform 
Correlators Used for Fingerprint Identification," Opt. Eng., 35(9), 2519-2525 (1996); 
P.K.H. Fielding, J.L. Homer and C.K. Makekau, "Optical Fingerprint Identification by 
Binary Joint Transform Correlation," Opt. Eng., 30(12), 1958-1961 (1991); C.L. Wilson, 
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CI. Watson, E.G. Pack, "Combined Optical and Neural Network Fingerprint Matching" 
in Optical Patteem Recognition Vm, D.P. Casasent and T. Chao, ed., Proc. Soc. Photo- 
Opt.Instrum. Eng. 373-383 (1997); J. Rodolfo, H. Rajbenbach and J-P. Huignard, 
"Performance of a Photorefractive Joint Transform Correlator for Fingerprint 

5 Identification," Opt. Eng., 34(4), 1 166-1 171 (1995); Refregier and B. Javidi, "Optical 
Image Encryption using Input and Fourier Plane Random Phase Encoding, " Opt. Lett, 
20, 767-769, (1995); M. Kowalczyk, "Spectral and Imaging Properties of Uniform 
Diffusers", JOSA A, Vol. 1, No. 2, 192-200, February 1984.; H. Kogehiik and K.S. 
Pennington, "Holographic Imaging Through a Random Medium", Optical Society of 

10 America., 58, 2, 273-274, (1968) which are incorporated herein by reference). 

Various kinds of optical data processing technology for information security have 
been proposed. (H.-Y.S. Li, Y. Qiao, and D. Psaltis, Appl. Opt. 32, 5026 (1993); B. 
Javidi and J.L. Homer, Opt. Eng. 33, 1752 (1994); P. Refregier and B. Javidi, Opt. Lett. 
20, 767 (1995); F. Goudail, F. Bollaro, B. Javidi, and P. Refregier, J. Opt. Soc. Am. A15, 

15 2629 (1998); C.L. Wilson, C. I. Watson, and E.G. Pack, Proc. SPIE 3078, 373 (1997); D. 
Weber and J. Trolinger, Opt. Eng. 38, 62 (1999); O. Matoba and B. Javidi, Opt. Lett. 24, 
762 (1999), all of which are incorporated herein by reference). In one approach (P. 
Refregier and B. Javidi, Opt. Lett. 20, 767 (1995), which is incorporated herein by 
reference), the data are encrypted optically by double-random phase encoding with 

20 uniformly distributed random phase keys in both the input and Fourier planes. In 

addition, digital holographic techniques (U. Schnars and W. Juptner, Appl. Opt. 33, 179 
(1994); B. W. Schilling, et al, Opt. Lett. 22, 1506 (1997); E. Cuche, F. Bevilacqus, and C. 
Depeursinge, Opt. Lett. 24, 291 (1999), which are incorporated herein by reference) that 
use a CCD camera for direct recording of a hologram have become available owing to the 

25 development of the imaging technology. 

The following references are incorporated herein by reference in their entirety: 
R.O. Duda, P.E. Hart, Pattern Classification and Scene Analysis, J. Wiley and Sons, 
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1973; R. SchalkofF, Pattern Recognition Statistical, Sti^ctural and Neural Approaches, 
J.Wiley and Sons 1992; P. Hariharan, Optical Holography Principles Techniques and 
Approaches, Cambridge University Press 1984; W.H. Lee, Computer Generated 
Holography, Techniques and Applications, Progress in Optics, Vol 16, Ed., E. Wolf, 
5 Amsterdam North Holland 1 978; J.W. Goodman, Introduction to Fourier Optics, 
McGraw-Hill 1996. 

SUMMARY OF THE INVENTION 

In this invention a new method for optical security verification based upon phase 
encoded convolution of a primary image with a random phase code is proposed. The 

1 0 convolution of the primary image and the random code yields position-invariance to a 

possible shift of the primary image or the random code. In this method, a nonlinear joint 
transform correlator (JTC) verifies biometric information and the random code 
simultaneously to determine whether or not an object, such as an ID card, is authentic and 
thus whether the object is being used by an authorized person. The binarization of the 

1 5 phase information encoded on the input card is disclosed. A composite reference image, 
obtained from a set of rotated primary images and convolved with the random code, in 
order to obtain position and rotation-invariance, is used. The system tolerates rotational 
variations of the input images. The performance of the proposed method is investigated 
using a number of metiics. An optoelectronic architecture is proposed to perform the 

20 verification. The discrimination capability of the proposed method against unauthorized 
codes or unauthorized primary images is investigated in the presence of additive noise 
and distortions. The robustness of the proposed method in the presence of noise and 
distortions such as missing data is addressed. 

The proposed method for security is based upon convolution of the primary image 
25 by a random code. The primary image f(x,y) is phase encoded, which can be 

mathematically represented by, expfi Ttf(x.y) / Max(f(x,y))J . The range of variation of the 
phase encoding is [0, tc]. The phase-encoded primary image is convolved with a random 
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code c(x,y). In this invention the random code c(x,y) is chosen to be the Fourier transform 
(FT) of a phase only uniform random distribution(M. Kowalczyk, "Spectral and Imaging 
Properties of Uniform Diffiisers", JOSA A, Vol. 1, No. 2, 192-200. February 1984, which 
is incorporated herein by reference). With this choice of c(x,y) the invention is assured of 
5 having high light efficiency output. The resulting convolved image is a complex 
amplitude distribution: 

rix^) = exp[i 7tJ{x,y) I Max{J{x^))] ® c(x j;), ( 1 ) 

where ® denotes convolution. 

The convolved image r(x,y), will be placed on a card or the object to be verified. 

10 It will serve as the reference image to the optical processor. Therefore, the information 
encoded on the card is a combination of primary information/fx,;;; and a machine code 
c(x.y). For additional security, the convolved pattern r(x,y), placed on the ID card or any 
personal document, can be made to be phase-only information by setting the ampHtude of 
the complex distribution r(x,y) equal to one ( S. Maze and Ph. Refiregier, "Optical 

15 Correlation: Influence of the Coding of the Input Image" Appl. Opt. 33, 6788-6796 
(1994); S. Maze and Ph. Refi-egier, "Noise Robustness of Optical Correlation for 
AmpHtude or Phase Modulation of the Input Image", Opt. Lett., 17, 426-428, (1992) 
which are incorporated herein by reference). The phase only pattern reference image on 
the ID card or on the personal document is given by 

20 r{x,y)=^^^. (2) 



ix,y)\ 



This invention also investigates the performance of binarization of the phase 
information of the reference encoded on the document. The binarization of the reference 
image is given by: 
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-lifRe[r(x,y)]<0, 
lifRe[r(x,y)]> 0 



(3) 



where Re[r(x,y)] is the real part of r{x,y). 

A joint transform correlator (JTC) architecture(C.J. Weaver and J. W. Goodman, 
"A Technique for Optically Convolving Two Functions".4/7p/. Opt. 5, 1248-1249 (1966) 

5 which is incorporated herein by reference) is used to verify the authenticity of the card. 
A nonlinear JTC is more practical because of the limited dynamic range of optical 
devices. In addition, the nonlinear JTC offers many advantages in terms of correlation 
performance(B. Javidi, "Nonlinear Joint Transform Correlators," in Real-Time Optical 
Information Processing, B Javidi and J.L. Homer, Eds., Academic Press, New York, 

10 (1994); B. Javidi, 'TSIonlinear Joint Power Spectrum Based Optical Correlation," Appl. 
Opt. 28, 2358- 2367 (1989) which are incorporated herein by reference). A nonlinear 
joint transform correlator is used to perform the correlation between the convolution of 
the phase encoded primary pattern and the random code mask and the phase distribution, 
recorded on the card given by Equation 2. In the Fourier plane of the nonlinear joint 

1 5 transform correlator, a threshold function, V-r(a, P) (Fig. 2), is used which is the sum of 
the self-product terms of the joint power spectrum. A /r-th-power-law nonlinearity (0 
< 1) is applied to the modified joint power spectrum in the Fourier plane(B. Javidi, 
"Nonlinear Joint Transform Correlators," in Real-Time Optical Information Processing, 
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B Javidi and J.L. Homer, Eds., Academic Press, New York, (1994); B. Javidi, "Nonlinear 
Joint Power Spectrum Based Optical Correlation," Appl. Opt. 28, 2358- 2367 (1989) 
which are incorporated herein by reference). An inverse Fourier transform of the 
nonlinearly transformed joint power spectrum will generate the nonlinear joint transform 
5 correlator output plane. lfs(x^) is the signal to be verified, the nonlinear joint transform 
correlator output of the system is given by 

Outputix,y)=six,y)* r(x,y) (4) 

where the superscript (*k) denotes the ^-th law nonlinear joint transform correlation, and 
A: e [0,1] is the severity of the nonlinearity used in the Fourier plane(B. Javidi, "Nonlinear 

10 joint transform correlators," in Real-Time Optical Information Processing, B Javidi and 
J.L. Homer, Eds., Academic Press, New York, (1994); B. Javidi, "Nonlinear Joint Power 
Spectmm Based Optical Correlation," Appl. Opt. 28, 2358- 2367 (1989) which are 
incorporated herein by reference). The ^-th law nonlinear JTC in the Fourier plane is 
defined by: | RS | * exp{j(p, . j(Pn ] , where \R \exp[ j(p^ ] and Is \exp[ j(p, ] are the Fourier 

1 5 transforms of the reference image and the input image, respectively. When the phase of 
the reference input is binarized, the k-Xh law nonlinear joint transform correlator output is 
define as 

Output{x,y)= six,y)"' r g{x,y) (5) 

* 

A security method and system that combines double-random phase encryption 
20 with a digital holographic technique is disclosed. The proposed system allows for the 
digital storage, transmittal, and decryption of the encrypted data. One benefit of the 
proposed system compared with electronic encryption techniques is that optical 
processing provides many degrees of fi-eedom for securing information. Another benefit 
is that optical encryption is naturally suited to encrypting information, e.g., real images 
25 and information stored in holographic media, that exists in the optical domain. Either 



6 



optical or computer decryption techniques can be used with the proposed system, 
depending on the specific appUcation. Computer decryption is less secure because the 
phase key is stored electronically, but no manual focusing adjustment is required and the 
decryption system is more compact. 

5 Let f(x,y), a(x,y), and H(Cri) denote an image to be encrypted, an input random 

phase mask, and a Fourier random phase mask, respectively. The input random phase 
mask, a(x,y), is bonded with the image f(x, y). The resuhant product of the two images is 
Fourier transformed and is multiplied by the Fourier phase mask H(<^.r]). A second 
Fourier transform products the encrypted data. The encrypted data is recorded as a 

10 Fourier hologram, using an interference with the reference wave R(i.ri). The hologram 
1^(^,1]) can be written as 



+ 



{Fi^,ri)® Ai^,r;)]H{i,ri)^R(^,?iy (6) 



where F (Crj) and A (tri) denote Fourier transforms of f(x,y) and a(x,y), respectively, and 
<8) denotes a convolution operation. Inasmuch the first and second terms on the right-hand 
1 5 side of Eq. (6) can be known a priori by obtaining the power spectrum of the encrypted 
data and reference beam, the following holographic data, 1^ (f,?/), can be obtained: 
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Similarly, the holographic data of the Fourier phase mask, 1^. (^,r]), can also be obtained 
and is given by 



5 When the reference beam is a sUghtly inclined planar wave, the first term on the right- 
hand side of Eq. (7) and the second term on the right-hand side of Eq. (8) can be extracted 
by Fourier transforming the holographic data to obtain the encrypted data and the Fourier 
phase mask, respectively. By multiplying the extracted encrypted data and the Fourier 
phase mask followed by inverse Fourier transformation, the decrypted data, d(x,y), can be 

1 0 obtained as 

= f {^,yW^yl 

8 



where FT^ [] denotes the inverse Fourier transform operation and | H(c,/7>> 1 is equal to a 
constant because the phase mask has only phase value. The intensity of Eq. (9) produces 
the original image because f(x,y) is a positive real-valued function and a(x,y) is phase 
only. 

A system and method of verifying the authenticity of an object is presented. The 
method comprises providing a primary image; providing a secondary image; encoding the 
primary image; providing a random code; convolving the encoded primary image with 
the random code, providing thereby a reference image; affixing the reference image to the 
object to be authenticated; transforming the reference image; and comparing the 
transformed reference image with the secondary image. The system comprises a signal 
source; a first subsystem receiving a first signal from the signal source and providing as 
output therefrom a first output signal; a second subsystem receiving a second signal from 
the signal source and providing as output therefrom a second output signal; a third 
subsystem receiving the first and second output signals for comparing the first output 
signal with the second output signal. 

DESCRIPTION OF THE DRAWINGS 

Figure 1 is a schematic representation of a system for security verification of an 

object. 

Figure 1 A is a schematic representation of an optical setup for security 
verification of an object based upon a nonlinear joint transform correlator. 

Figure 2A is an authorized fingerprint used in the authorization. 

Figure 2B is an unauthorized fingerprint used in the authorization. 

Figure 3 A is the output correlation intensity of the nonlinear joint transform 
correlator for an authentic input with nonlinearity /: = 0.3 



Figure 3B is the output of the nonlinear joint transform correlator for an 
authorized input with an unauthorized code with nonlinearity k = 0.3. 

Figure 3C is the output of the nonlinear joint transform correlator for an 
unauthorized input with an authorized code with nonlinearity A: ^ 0.3. 

5 Figure 3D is the output of the nonlinear joint transform correlator for an 

unauthorized input and an unauthorized code with nonlinearity A: = 0.3. 

Figure 4 A is the fingerprint of Figure 2 as the input primary image corrupted by 
additive white noise with a mean of zero and a standard deviation of 0.3. 

Figure 4B is the fingerprint of Figure 2 A as the input primary image corrupted by 
10 addifive colored noise with a mean of zero and a standard deviation of 0.3 and a 
bandwidth of 15. 

Figure 5 A is the simulation results of the average of the discrimination ratio(DR) 
between an authorized card and an unauthorized card with an unauthorized fingerprint in 
the presence of additive white noise versus the nonlinearity index k. The results 
1 5 correspond to white noise on the reference image with a standard deviation of 0.7 and 

different input additive noise levels. The curves designated by an asterisk (*) correspond 
to the performance of the system in the absence of input noise. 

Figure 5B is the simulation results of the average of the discrimination ratio (DR) 
between an authorized card and an unauthorized card with an unauthorized code in the 
20 presence of additive white noise versus the nonlinearity index k. The results correspond to 
white noise on the reference image with a standard deviation of 0.7 and different input 
additive noise levels. The curves designated by an asterisk (*) correspond to the 
performance of the system in the absence of input noise. 

Figure 5C is the simulation results of the output Signal-To-Noise ratio (SNR) in 
25 the presence of additive white noise versus the nonUnearity index L The results 
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correspond to white noise on the reference image with a standard deviation of 0.7 and 
different input additive noise levels. The curves designated by an asterisk (*) correspond 
to the performance of the system in the absence of input noise. 

Figure 5D is the simulation results of the output Peak-to-Output Energy ratio 
5 (POE)in the presence of additive white noise versus the nonlinearity index L The results 
correspond to white noise on the reference image with a standard deviation of 0.7 and 
different input additive noise levels. The curves designated by an asterisk (*) correspond 
to the performance of the system in the absence of input noise. 

Figure 6 A is the simulation results of the average of the discrimination ratio(DR) 
10 between an authorized card and an unauthorized card with an unauthorized fingerprint in 
the presence of additive colored noise with a bandwidth of 1 5 versus the index 
nonlinearity L The results correspond to additive colored noise on the reference image 
with a standard deviation of 0.7 and different input additive colored noise levels. The 
curves designated by an asterisk (*) correspond to the performance of the system in the 
1 5 absence of input noise. 

Figure 6B is the simulation resuhs of the average of the discrimination ratio (DR) 
between an authorized card and an unauthorized card with an unauthorized code in the 
presence of additive colored noise with a bandwidth of 15 versus the index nonlinearity k. 
The results correspond to additive colored noise on the reference image with a standard 
20 deviation of 0.7 and different input additive noise levels. The curves designated by an 
asterisk (*) correspond to the performance of the system in the absence of input noise. 

Figure 6C is the simulation results of the output Signal-To-Noise ratio (SNR) in 
the presence of additive colored noise with a bandwidth of 15 versus the index 
nonlinearity k. The results correspond to additive colored noise on the reference image 
25 with a standard deviation of 0.7 and different input additive noise levels. The curves 

designated by an asterisk (*) correspond to the performance of the system in the absence 
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of input noise. 

Figure 6D is the simulation results of the output Peak-to-Output Energy ratio 
(POE)in the presence of additive colored noise with a bandwidth of 15 versus the index 
nonlinearity k. The results correspond to additive colored noise on the reference image 
5 with a standard deviation of 0.7 and different input additive noise levels. The curves 

designated by an asterisk (*) correspond to the performance of the system in the absence 
of input noise. 

Figure 7 is the input primary pattern with missing data when 25% of the 
authorized fingerprint is blocked. 

10 Figure 8 A is the correlation resuhs of the output correlation intensity for an 

authentic card with nonlinearity index k = 0.3 and 25% of the authorized fingerprint data 
missing. 

Figure 8B is the correlation results of the output correlation intensity for an 
authorized input with an unauthorized code with nonlinearity index k = 0.3 and 25% of 
1 5 the authorized fingerprint data missing. 

Figure 8C is the correlation results of the output correlation intensity for an 
unauthorized input with an authorized code with nonlinearity index k = 0.3 and 25% of 
the authorized fingerprint data missing. 

Figure 8D is the correlation results of the output correlation intensity for an 
20 unauthorized input with an unauthorized code with nonlinearity index k = 0.3 and 25% of 
the authorized fingerprint data missing. 

Figure 9A shows the correlation results for discrimination between an authorized 
and an unauthorized input using the rotation-invariant reference image encoded on the 
card for an authorized input. 
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Figure 9B shows the correlation results for discrimination between an authorized 
and an unauthorized input using the rotation-invariant reference image encoded on the 
card for an unauthorized input with an unauthorized fingerprint. 

Figure 9C shows the correlation results for discrimination between an authorized 
5 and an unauthorized input using the rotation-invariant reference image encoded on the 
card for an unauthorized input with an unauthorized code. 

Figure 9D shows the correlation results for discrimination between an authorized 
and an unauthorized input using the rotation-invariant reference image encoded on the 
card for an unauthorized input with an unauthorized fingerprint and an unauthorized code. 

10 Figure 10 is the binary phase information encoded at the input. 

Figure 1 1 A is the correlation results for discrimination between the authorized 
and unauthorized cards using the binarization of the reference encoded at the input for an 
authorized input. 

Figure 1 IB is the correlation results for discrimination between the authorized and 
1 5 unauthorized cards using the binarization of the reference encoded at the input for an 
unauthorized input with an unauthorized fingerprint. 

Figure 1 IC is the correlation results for discrimination between the authorized and 
unauthorized cards using the binarization of the reference encoded at the input for an 
unauthorized input with an unauthorized code. 

20 Figure 1 ID the correlation results for discrimination between the authorized and 

unauthorized cards using the binarization of the reference encoded at the input for an 
unauthorized input with an unauthorized fingerprint and an unauthorized code. 

Figure 12A shows the transmitter-encoder of a secure image/video- 
storage/transmission system that uses a combination of double-random phase encryption 
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and a digital holographic technique. 

Figure 12B shows the receiver-decoder of a secure image/video- 
storage/transmission system that uses a combination of double-random phase encryption 
and a digital holographic technique. 

5 Figure 1 3 shows an optical arrangement in the nature of a Mach-Zehnder 

interferometer. 

Figure 14 shows the digital input images. 

Figure 15A shows a digital hologram of the encrypted data. 

Figure 1 5B shows a digital hologram of the Fourier phase mask. 

10 Figure 16 shows the digitally reconstructed encrypted images by inverse Fourier 

transforming the encrypted data in Fig. 1 5 A. 

Figure 17 shows the digitally reconstructed images that have been decrypted 
inverse Fourier transforming the hologram of the encrypted data of Fig. 15 A with 
hologram of the Fourier phase mask of Fig. 15B. 

1 5 DESCRIPTION OF THE PREFERRED EMBODIMENTS 

In Figure 1 a schematic representation of a system for security verification is 
shown generally at 700. In particular in Figure 1 a source of coherent light 100 is 
provided to illuminate 102 first and second Fourier transform optical subsystems 200, 
300. The first Fourier transform optical subsystem 200 provides as output therefi-om a 
20 first optical output signal 206 indicative of the Fourier transform of the convolution of the 
random code, c{x,y), and the phase encoded primary image, Qxp{mJ{x^)/Max\f{x,y)]}. 
The second Fourier transform optical subsystem 300 provides as output therefirom a 
second optical output signal 312 indicative of the Fourier transform of the a phase only 
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convolved image, r (xV). The first and second optical output signals 206, 312 are 
detected at a detector 400. A signal 402 indicative of the joint power spectrum of the first 
and second optical signals 206, 312 is provided as output from the detector 400 to a 
verification subsystem 500 for correlation thereof 

5 The optical setup for security verification 700 is shown in Figure 1 A as a 

nonlinear joint transform correlator (JTC) 700. The optical system 700 consists of two 
arms. In one arm, the convolution of a secondary image such as the phase encoded 
primary pattern exp{iTifix,y)IMax\f{x^)]} and the random code, c(x,y), is performed by 
use of a spatial filter matched to the random code c(x,y). and positioned in the Fourier, or 

1 0 (m,v) plane. The phase-encoded primary pattem is displayed by means of a spatial light 
modulator (SLM) 208. Fourier transform lens L, 210, images the Fourier transform (FT) 
of the phase-encoded primary pattem, F(u,v). in the Fourier, or {u,v), plane. The 
processor 700 has an a-priori knowledge of the random code mask c(x,y). Thus, in the 
CM,v;-plane, a filter 212 with transmission C(u,v) is placed. C(u.v) is the Fourier 

1 5 transform of the random code c(x,y) . Lenses and Lj (2 1 4, 2 1 6), image the complex 
amplitude distribution, formed at the filter plane, onto the Ca,^;-plane, where a detector 
400 is placed. Thus the Fourier transform of the convolution between the two functions 
expfi Kf(x,y) /Maxf(x.y)JjzxiA c(x,y) is obtained in (a,p)-^\mQ. In the other arm, an 
object, whose authenticity is to be verified and including a reference image such as the 

20 phase only distribution, r {x\y), is placed in the input plane (x ',y') of the processor 700. 
Coherent light 308 illuminates the reference image 602. Lens L4 306 images the Fourier 
transform of r (x ',y ') onto the ^a,y?>plane of the detector 400. Thus, a joint power 
spectrum is obtained in (a,fi)-planG. The joint transform interference intensity is recorded 
by the detector 400 and is nonlinearly transformed by a nonlinear threshold fimction 

25 generator 502 in the verification subsystem 500. The resulting modified joint transform 
spectrum 504 is inverse Fourier transformed 506 and the modulus thereof squared to 
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obtain the correlation of the primary image and the reference image. The correlation 
signal may be obtained either by performing optical Fourier transform by displaying the 
modified intensity distribution written on the SLM, or by using discrete Fourier 
transform. 

It will be appreciated to one skilled in the art that the aforedescribed system 700 
for verifying the authenticity of an object is not limited to an optical system but also 
encompasses electronic systems as well as combinations thereof It will also be 
appreciated that the signals generated therein may be either one dimensional or two 
dimensional or n dimensional. 

Computer simulations have been conducted to investigate the performance of the 
proposed optical systems. 

In the simulations, a discrimination capability of the security system against an 
unauthorized input card is examined. The card is considered to be unauthorized, when 
either the input primary biometric image or the random code is unauthorized. To 
evaluate the discrimination, we define the discrimination ratio (DR) as 



where max[^C(x,j;)] is the auto-correlation peak value, and max[CC(x,3;)] is the 
maximum value of the cross-correlation output. The auto-correlation is defined as 



DR = 




(10) 



max 



[cc(x,:v)] 
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(11) 

where f(x,y) is the authorized primary pattern and c(x,y) is the authorized code as defined 



above. The cross-correlation is defined as 



CC(x, y) = [exp[i;r g(x, y) / Max(g(x, y))] ® a(x, y)]* x 



^ exp[i;r f(x,y) / Max(f(x,y))] ® c(x,y)^ 



exp[i;r f(x, y) / Max(f(x, y))] ® c(x, y) 



(12) 

where g(x,y) is an unauthorized primary pattern and a(x,y) is an unauthorized code. The 
higher the DR, the better the discrimination of the system is against unauthorized inputs. 

In addition, the robustness of the proposed optical security system in the presence 
of additive input noise is investigated. In the noise performance tests of the system, both 
white and colored noise are considered. The performance of the proposed method is 
investigated using a number of metrics. The signal to noise ratio, SNR, is defined as the 
ratio of the expected value squared of the correlation peak amplittide to the variance of 
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the correlation peak amplitude. And the peak-to-output energy ration metric, POE, is 
defined as the ratio of the expected value squared of the correlation peak to the average 
expected value of the output signal energy. 

Throughout the simulations, fingerprint biometrics are used as the primary image; 

5 however the other biometrics can be used as well. The optical processor 700 was first 

tested for authenticity of a card encoded with a fingerprint information convolved with a 
random code in the absence of input noise and distortions. Two fingerprints are selected 
for computer simulation as shown in Figures 2 A and 2B. The fingerprint in Figure 2 A is 
chosen as authentic and the fingerprint in Figure 2B is considered as an unauthorized 

10 biometiic image to be rejected. Figure 3 A is the output correlation intensity for the 

authentic card, when the authorized fingerprint and code are used. A sharp and sfa-ong 
output peak for the authentic card is obtained. The simulations in Figure 3 were 
performed with nonlinearity index of ^ = 0.3 for the correlator. In the experiments, the 
correlation output are normalized by the maxmium correlation peak obtained by the 

1 5 authentic card. Figures 3 B, 3C and 3D show the output correlation intensity for the 
false-class input for which low level cross-correlations appear. Figure 3B shows the 
output correlations for an authorized fingerprint and an unauthorized random code. 
Figure 3C shows the correlation outputs for the authorized random code and an 
unauthorized fingerprint. Figure 3D shows the output correlation planes for an 

20 unautiiorized fingerprint and an unauthorized code. 

The correlation output of the proposed processor is investigated in the presence of 
input noise or other distortions such as missing data in order to shidy the robushiess of 
the system. To test the noise tolerance of this method, different kinds of additive noise 
are considered. The reference to be verified may contain some surface noise, due to 
25 continuous use. Also, during tiie real time regisfa-ation of the primary pattern for 
verification, the detector may inti-oduce some noise which is considered in the 
simulations. The output of the nonlinear joint ti-ansform correlator in the presence of 
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additive noise can be written as: 



Output(x,y) = (exp i;r(f(x,y) + (x, y)) / Max(f(x, y) + (x,y))]0 c(x,y)| x 

exp[i;r(f(x,y))/Max(f(x,y))]® c(x,y) , 



|exp[i;r(f(x,y))/Max(f(x,y))]® c(x,y) 



(13) 

where n (x,y) and (x.y) are the additive noise present on the primary image and, the 
card, respectively. 

Simulation results are presented to illustrate the robustness of the system against 
additive noise using a k-th law nonlinear JTC. The signal to noise ratio (SNR), 
discrimination ratio (DR), and peak-to-output energy ratio (POE) are measured. The 
simulation of the input noise on the input card and on the reference image has been 
carried out for several values of standard deviation. The performance parameters are 
computed for 50 different sample realizations of the input signals corrupted by noise. 

The experiments were conducted with both additive white noise and colored 
noise. In the simulations, a range of values for the nonlinearity index k of the correlator 
has been tested. The input biometrics were corrupted by Gaussian noise, with a standard 
deviation equal to 0. 1 , 0.2 and 0.3. Figure 4A shows the noisy image with white noise of 
standard deviation 0.3. In the simulations, the reference encoded on the card is also 
corrupted by a zero mean additive white noise with a standard deviation equal to 0.3, 0.5 
and 0.7. The noise robustness variation results obtained are similar for all three levels of 
noise that corrupt the information encoded on the card. The results obtained with a noise 
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level standard deviation equal to 0.7 are presented. The experiment was performed by 
simulating 50 realizations of white noise. 

Figures 5 A and 5B show the variation of the discrimination ratio (DR) versus the 
nonlinearity index k of the correlator, when the primary pattern is corrupted by additive 
5 Gaussian white noise with different standard deviations. Figure 5A corresponds to the 
discrimination against unauthorized input card with an authentic code and an 
unauthorized fingerprint. Fig 5B corresponds to the discrimination against unauthorized 
input card encoded with an unauthorized code and an authentic fingerprint. 

Figures 5C and 5D illustrate the SNR and the POE respectively as a fimction of 
10 the nonlinearity k when the primary pattern is corrupted by additive Gaussian white noise 
with different standard deviations. 

The experiments were repeated with the biometrics images that were corrupted by 
zero mean additive colored noise of bandwidth equal to 15, and various standard 
deviations. Figure 4B shows the corrupted image with additive colored noise with a 

15 standard deviation equal to 0.3 and bandwidth of 15. In the simulations, the encoded 
reference on the card is also corrupted by a zero mean additive color noise with 
bandwidth of 15 and a standard deviation equal to 0.3, 0.5 and 0.7. The results obtained 
for the reference corrupted with an additive colored noise with a standard deviation equal 
to 0.7 are presented. The experiment was done over the results of 50 realizations of 

20 independent noise. 

Figures 6 A through 6D illustrate the performance of the processor versus the 
nonlinearity index k in presence of the additive colored noise, in terms of DR, SNR and 
POE, respectively. Figures 6A and 6B correspond to the false-class inputs with an 
unauthorized fingerprint and an unauthorized code, respectively. 

25 The robustness to missing data during the acquisition of the primary pattem 

information is tested. Figure 7 shows an example of input primary pattem with missing 
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data when 25% of the authorized fingerprint is blocked. The results of the tests with 
missing input data are presented in Figure 8. In the simulation presented here, additive 
white noise used for both the input primary pattern (with a standard deviation equal to 
0.3) and for the reference encoded on the credit card (with a standard deviation equal to 



System performance using rotation-invariant encoded references is disclosed. In 
real applications of the system, rotation of the primary pattern during acquisition of the 
fingerprint may occur. Some simulations of in-plane rotation indicate that, the system 
'proposed in this invention can tolerate one degree of input image rotation. The sensitivity 
depends on the nonlinearity index k. The smaller the nonlinearity index the more 
sensitive the system is to rotation changes in input primary pattem. The range of the 
rotation of the primary pattem during the acquisition process may be very limited, and it 
can be reduced by the system, using a guide for the user's finger: thus a controlled 
environment may be used. 

To improve the rotation robustness of the system, a rotation invariant primary 
pattem using a training set of rotated images is developed. The rotation invariant primary 
pattem is encoded on the card. This rotation invariant primary pattem is a linear 
combination of several images of a single fingerprint. Each image is rotated by a small 
angle. 

The rotation-invariant pattem encoded on the card is given by the following 
equation. 



0.7). 



p(x,y)- 




X exp [ill X (x, y) / Max(f (x, y)) ] ® c(x, y) 



X exp i;r f (x,y) / Max(f (x,y)) ® c(x,y) 




(14) 
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whereX (x.y) is the primary pattern rotated by an angle a. In the experiment presented 
here the sum is over -10 to +10 degrees in increments of 1 degree, and the rotation axis 
coincides with the center of the image. The correlation resuhs correspond to nonlinear 
JTC for A: ^ 0.3. Figure 9 A is the output correlation intensity for the authentic input card, 

5 using a rotation-invariant reference image encoded on the card. Here the correct 

fingerprint is rotated by 7 degrees and the authorized code is used. A sharp and strong 
output peak is obtained. Figures 9B, 9C and 9D show the output correlation intensity for 
false inputs, where no correlation peak appears. In the simulation presented here, 
additive white noise is taken into account for forth the input primary pattern (with a 

10 standard deviation equal to 0,3) and for the reference encoded on the card (with a 

standard deviation equal to 0.7). In the experiments, the correlation output is normalized 
by the maximum correlation peak obtained by the authentic card. Figure 9B shows the 
correlation output for an authorized random code and an unauthorized fingerprint. Figure 
9C shows the output correlation for an authorized fingerprint and an unauthorized random 

15 code. Figure 9D shows the output correlation plane for an unauthorized fingerprint and an 
unauthorized code. The tests illustrate that the rotation invariant reference image 
provides tolerances to rotation of input primary images. 

The system performance when the phase information encoded on the card is 
binarized is disclosed. Display of the complex spatial distribution on the card may not be 

20 trivial. To remedy this problem, the binarization of the distribution which is to be 

encoded on the card is tested. The reference image encoded on the card at each point is 
set equal to 1 when the real part of the reference image is positive and equal to -1 
otherwise as seen in Eq. 3. This approach leads to a 2-D binary pattern placed on the 
card. It is shown that in the simulation, the verification and the validation are obtained 

25 with high accuracy. Figure 10 illustrates the binary phase distribution encoded on the 
card obtained by using Eq. 3. 

Figure 1 1 A is the output correlafion intensity for the authentic card. Figures 1 IB, 
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1 IC and 1 ID show the output correlation intensity for an unauthorized card for which no 
correlation peak appears. Figure 1 IB shows the correlation output for an authorized 
random code and an unauthorized fingerprint. Figure 1 IC shows the output correlation 
for an authorized fingerprint and an unauthorized random code. Fig 1 ID shows the 
output correlation plane for an unauthorized fingerprint and an unauthorized code. 
Binarization of the information on the card in the proposed system can provide good 
discrimination ratio for verification and validation. 

Figures 12A and 12B show a secure image/video-storage/transmission system 
based upon the proposed holographic system. The data are encrypted optically by the 
double-random phase encryption technique and recorded as a digital hologram. The 
optical key, that is, the Fourier phase mask, can also be recorded as a digital hologram. 
The encrypted data can be decrypted digitally with the hologram of the optical key. 

Referring to Figure 13, a Mach-Zehnder interferometer is shovra generally at 800. 
A Helium-Neon laser 802 is used as a coherent light source. The lower arm 804 of the 
interferometer 800 is the optical path of the image encryption. The upper arm 806 is the 
reference wave. The input image to be encrypted is bonded with the input phase mask at 
plane Pi (808). This product is transformed by lens L, (810). Such transformation may 
be for example a Fourier transformation or a Fresnel transformation. The transformation 
is multiplied by the Fourier phase mask at plane (812) and imaged onto the CCD 
camera by the 4-/optical system of lenses (814) and L3 (816). The reference wave 
passes through the 4-/optical system of lenses L4 (818) and L5 (820) to maintain the 
spatial coherence. 

At the CCD camera 840, a hologram is created by the interference between the 
encrypted data and the slightly inclined reference plane wave 842. The hologram 
captured by the CCD 840 camera is sampled with 512 X 480 pixels and is quantized to 8 
bits of gray levels by a fi-ame-grabber board (not shown). The input image, the input 
phase mask, and the lens L, (810) are removed when we record the hologram of the 

23 



Fourier phase mask. In the experiments, a random phase mask is used with a correlation 
length of less than lO/dn as an input phase mask and a lens as the Fourier phase mask. 

The reason why a lens is used is the lack of sufficient space-bandwidth product of 
both the optical system 800 and CCD camera 840 to permit use of a wide-angle random 
5 phase make with a small correlation length of less thanlO/<m. To remedy this problem, 
phase masks can be designed to take into account the available space-bandwidth product 
of the optical system. Lens (810) has a numerical aperture of 0.10, lenses (814) and 
L3 (816) each have a numerical aperture of 0.14, and lenses L4 (818) and L5 (820) each 
have a numerical aperture of 0.17. The CCD array 840 has dimensions 6.4 x 4.8mm. 

10 Figure 14 shows the input images to be decrypted. These electronically 

reconstructed images are obtained with an input phase mask without the Fourier phase 
mask. Scattering that is due to the thickness of the input random phase mask and the 
limitation on the numerical aperture of the lens Lj (810) are the reasons why the images 
are somewhat noisy. 

1 5 Digital holograms of the encrypted data and the Fourier phase mask are shown in 

FigureslSA and 15B respectively. The digitally reconstructed encrypted images are 
shown in Figure 16. These images were obtained by inverse Fourier transforming of the 
digital hologram of the encrypted data. The original images cannot be recognized. The 
mean-square errors between the original images "MEMORY" and "UCONN" of Figure 

20 14 the encrypted images of Figures 15A and 15B are 7.3 and 6.6, respectively. The 

digitally reconstructed images that have been decrypted with the hologram of the Fourier 
phase mask are shown in Figure 17. The original images can be seen. The mean-square 
errors between the original images "MEMORY" and "UCONN" of Figure 14 and the 
decrypted images of Figure 17 are 0.97 and 1.1, respectively. The experimental results 

25 demonstrate the feasibility of the proposed method. 

Thus, a new method and system for security verification of objects such as a 
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credit card or an ED card, using optical pattern recognition has been shown. This method 
is based on phase encoded convolution of the primary pattern with a random code placed 
on the card. An optical system to perform the verification has been described. The 
correlation is performed using a nonlinear joint transform correlator (JTC). For the 
5 images presented here, the proposed method can identify an authorized input by 

producing well defined output peaks, and it rejects the unauthorized input with a high 
discrimination ratio. The performance of the system in terms of input noise, biometric 
rotation, and missing data has been investigated. For the tests provided here, the 
proposed system is found to be robust to noise added to the input primary pattern and to 

10 the reference pattem encoded on the card. Nonlinear correlation allows a compromise 
between the noise tolerance and the discrimination ratio. The tests using missing data 
show that, for the fingerprint image used in the simulation, the system provides good 
tolerance up to 25% of missing data in the input primary pattem and that the security 
verification of the authorized input is highly discriminate against the unauthorized inputs. 

15 A rotation invariant composite reference primary pattem is designed to provide tolerance 
to rotation of the input primary image. Binarization of the phase information encoded on 
the card has been tested. The results indicate that the verification is obtained with high 
discrimination ratio of authorized inputs against unauthorized inputs. 

An image security method and system that uses digital holography has also been 
20 presented. This method allows the encrypted data to be stored, transmitted, and 

decrypted digitally. Optical experiments have been shown to illustrate the proposed 
method. The system can be used for secure video storage and transmission. 
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